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I.  INTRODUCTION 

Tin*  constraints  of  large  linear  programs  can  often  lie  part  it  i<  uxmI  into  independent  subsets.  except 
for  relatively  few  <  oupling  rows  and  coupling  eolunins.  The  individual  siilisets  may.  for  example,  arise 
from  constraints  on  the  activity  levels  of  subdivisions  of  a  large  corporation.  Alternatively,  such  blocks 
may  arise  from  activities  in  different  time  periods.  The  coupling  rows  may  arise  front  limitations  on 
shared  resources  or  from  combining  the  outputs  of  subdivisions  to  meet  overall  demands.  The  coupling 
columns  arise  from  activities  which  involve  different  time  periods  te.g..  stora^cl.  or  vvhieh  involve  dif¬ 
ferent  subdivisions  (c.g..  transportation  or  assembly).  The  ease  with  only  coupling  rows  or  coupling 
columns,  but  not  both  has  received  much  attention  ( H  ] .  j‘>|.  A  smaller  amount  of  Work  has  been  done 
on  the  problem  with  both  coupling  rows  and  columns.  Killer  lias  proposed  a  dual  method  |2j.  |7J. 
Kxccpt  for  the  preliminary  work  of  Webber  and  White  [  10]  and  lieesterman  |  l|.  there  is  no  primal 
algorithm  which  exploits  the  structure  of  this  problem.  There  is  a  need  Ibr  such  an  algorithm,  since 
such  problems  oecut  often  in  practice.  A  primal  method  is  desirable  since  in  large  problems  slow  con¬ 
vergence  may  force  termination  of  the  algorithm  prior  to  optimality. 

The  algorithm  proposed  here  is  an  cxi.msion  of  the  generalized  upper  bounding  method  for  prob¬ 
lems  without  coupling  columns  proposed  in  ( .’> )  and  [(>].  It  produces  the  same  sequence  of  extreme 
point  solutions  as  the  primal  simplex  method,  and  hence  has  the  desirable  convergence  properties  of 
that  algorithm.  However,  the  operations  within  each  simplex  iteration  are  organized  to  take  maximal 
advantage  of  problem  structure.  Because  of  this  structure  it  is  possible  to  perform  the  computations 
while  maintaining  a  compact  representation  of  the  basis  inverse.  In  particular  it  is  sufficient  to  main¬ 
tain  and  update  at  each  cycle  a  working  basis  inverse,  inverses  from  each  block,  and  possibly  another 
matrix.  I  in  (4).  The  dimension  of  the  working  basis  need  never  be  more  than  the  number  of  coupling 
rows  in  the  problem  plus  the  number  of  coupling  columns  in  the  current  basis.  Hence  its  dimension 
may  change  from  cycle  to  cycle.  \t  most  one  of  the  block  inverses  need  be  updated  at  any  interation. 
(oven  these  quantities,  all  information  needed  to  carry  out  a  simplex  iteration  can  easily  he  obtained. 
Further,  efficient  relations  are  given  for  updating  the  working  basis  and  block  inverses  and  I  for  the 
next  cycle. 

\  significant  amount  of  computational  work  has  been  done  on  a  special  class  of  production  and 
inventory  problems.  IVoblems  as  large  as  ,'W)2  rows  by  .'f22.'>  columns  were  solved,  (lomputatiou  time* 
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.nr  riiiniii ,i"in^.  .1  ll I n >i ■  *i! i  mu  ronip.irisntis  will)  other  methods  air  available.  file  results  imliralr  that 
tin-  algorithm  I-  «rii»ili\r  In  I  hr  <  I  i  ii  1 1- n » it  m  ol' t  tit-  vvorkin"  basis  anil  llial  rib-dive  measures  ran  hr 
l.ikrn  in  i n i i il in i/i-  llii'  1 1 i ini- 1 1 -ii hi. 

Wlirn  dirir  air  only  roupliii"  lows.  tin*  algorithm  simplifies  rousidrrahl)  ami  reduces  In  the 
|  n  i  nri  I  ii  i  r  described  in  |  .">  | .  W  In- n  rarli  diagonal  lilnrk  contains  only  a  sinn.lt-  row.  il  reduces  further 
In  dir  ”rnrrali/ril  n  |i|  n-r  lii  ill  in  Ii  ii  n  i  n  r  tl  ii  ii  I  nl  Ibml/i"  ami  \  an  Slykr  [  I  | 

2.  li  VSIS  STIU'CTI'KK 

I  hr  l  >l'i  •!  >  It  - 1  n  considered  lint-  is 

miliimi/.r  im 

subject  In 

W„.i„  t-  j?  l  ,  \,  l>„ 

I  I 


l>,\„  i  H, \,  h,  p. 


where  i,  is  a  vt-clnr  with  ii ,  riitn|iiiiirnls.  all  nl  which  must  hr  nnnnri'utivr  except  for.im,  the  first  com- 
pntirnl  nl  The  riihiinn  corresponding  In  is  all  zrrn  except  for  a  1  in  the  first  row.  This  first  row  of 
the  constraint  matrix  then  defines  the  objective  fnnetinn.  In  matrix  form  the  constraints  ran  he 
represented: 
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The  prnhlrni  has  />  diagonal  hlorks  of  dimension  m,Xn,  and  an  l.-shaped  liorder  consisting  of  m„ 
coupling  constraints  and  ii„  ronplin^  variables  The  set  .S',  denotes  either  the  variables  in  the  vector 
i,  or  the  cohinnis  of  ill  associated  with  these  variables.  The  total  constraint  matrix  has  dimension 
1/  x  V  W  e  assume  throughout  that  this  matrix  has  rank  M  so  that  any  basis  matrix  for  the  system  will 
contain  1/  column'  and  will  lie  mnisin^ular. 
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(!nn-iilri  llic  -I  i  ml  in  r  nl  any  hu*i».  It.  Im  t Ilf  -Ssll  in  nl  constraint-  1 1 1.  \i  i auging  I  In-  i  <  >1  ii  1 1 1 1 1-  nl 
It  in  tlir  same  imlrr  as  in  1 1 ).  yields  the  basis  matrix  in  Figure  I  w  here  t lit*  shaded  arras  nintain  non/cro 
rnl i irs.  Tlir  niliiinn  Im  im  is  always  in  ihr  basis  anil  will  always  In  ilir  In s|  basic  mliinin. 


coupling 

COLUMNS 

<5, 


I'  ll. I  HI.  I 


lii  this  example  I  lit*  problem  has  seven  hlocks.  There  are  no  columns  from  block  3  in  ibis  particular 
basis.  The  basis  matrix  consists  of q  rectangular  blocks,  i/  />.  roughly  along  the  diagonal  wit  it  holders 
from  the  coupling  rows  and  coupling  columns.  The  rectangular  blocks  may  lie  either  "lull."  "square." 
or  "wide." 

The  algorithm  to  he  developed  depends  on  having  the  lower  right  hand  partition  of  It  consist  of 
square  nonsingular  blocks  along  the  diagonal.  Our  strategy  for  handling  the  nuusquarc  blocks  will  lie  to 
rearrange  the  rows  and  columns  of  the  basis  matrix  as  follows: 

a)  For  blocks  with  a  column  excess,  move  tin*  extra  columns  over  beside  tin*  coupling  columns 
leaving  a  square  block. 

b)  For  blocks  with  a  row  excess,  move  the  extra  rows  up  with  tin*  coupling  constraint  rows  leaving 
a  square  block. 

c)  Assure  that  the  resulting  square  diagonal  blocks  are  noiisingular. 

Performing  these  operations  on  the  basis  It  in  Figure  1  will  give  the  matrix  in  Figure  2.  where  we  have 


I  n. i  in  1 
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labeled  ili>  i < ■- 1 1 1 1 1 1 1 ^  min'  'iiliimit rices  Ini  rrlrrrnrr  iii  Tl . .'in  I.  The  siihmatrix  y,i  contains  square 

1 1. .11 ' i ti^iu Li t  1 1 li ><  k -  ami  lirnrr  it  is  nonsingulnr.  For  this  example  lilnrk  was  slill  singular  alter  it  was 
made  square.  si.  extra  low-column  pairs  were  iriiimnl  hum  it  until  thr  remaining  lilnrk  lirramr  mni- 
'Uigul.n  I  hi-  ilmducrd  linin'  rxi  rs-  lows  anil  ri.luinns  anil  created  nonzero  I'lrmrnls  in  llir  suli- 
inalrix  /<_■. 

Ini  computational  purposes  I  In-  lilnrk  diagonal  srrlinn.  y:(  slmnlil  lir  as  large  as  pnssililr.  hut  slill 
iioii'ingidar.  \  lower  hound  mi  ils  size  is  nnw  derived. 

rilKOHKM  1:  l.rl  .S’  hr  t In*  ilimmsinn  of  the  hlnrk  diagonal  srrlinn  y:i  of  Figure  2.  anil  1/  llir 
iliiiirii'inn  n|  (hr  rulin'  luisis  matrix.  Supposr  that  llir  partitioning  lias  licrn  ilunr  so  all  diagonal 
hlnrks  air  noiisingular.  ami  dial  llirrr  is  nn  altrrnalr  partitioning  wliirli  wnnlil  jti v**  larger  nonsiugular 
hlnrks.  I  lirn  S'  ■  1/  /„  m„. 

I’KOOF:  l.rl  am  basis  inalrix  I'nr  I  II  br  purliliniinl  as  illust  rati'ii  in  Figure  2: 
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Tin-  blin  k  diagonal  siihmatrix  y:t  is  iimisi n " ii lar .  ami  lirnri'  lias  rank  .S'.  ( ionsider  llir  submalrix  | /in.  y:i  | . 
It  also  lias  rank  .S'  siiirc  it  lias  .S'  linearly  independent  columns  (those  of  y:d  and  only  S  rows.  Suppose 
there  is  a  row  j/L  y|  ul'ihr  subniatrix  ( .  y_. )  which  is  not  a  linear  combination  of  the  rowsol  [/Ti.y.il 
and.  sa\ .  this  row  i«  an  excess  mw  from  block  /.  Ity  llir  special  structure  nl  this  row  ( y  is  zero  except 


block  / 1  there  must  hr  at  least  one  exei 


oluinn  in 


Pi 

P*\ 


I  min  the  same  block/.  (otherwise  the  row 


|/.L  y  |  could  not  be  independent).  Since  thr  row  |/L  y|  is  independent  of  the  rows  in  thr /’ill  block  of 
I  /ii .  y,  | .  tbi»  row  and  one  of  the  excess  columns  ran  br  adjoined  to  the /ill  block  to  give  a  larger  square 
noii'iiigular  block  than  before,  lint  this  contradicts  the  hypothesis  of  the  theorem.  Hence  every  row 
of  |/L.  y_’ )  is  a  linear  combination  of  rows  of  [/LL.  y.» ] .  This  proves  that  the  submatrix 
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Ini'  rank  \djoin  the  first  /„  •  I  columns  to  K  giving  the  submatrix  /, 


l  <*i 

■  S  +  /„  since  only  l„  +  I  columns  were  added  and  thr  first  of  these  is  all  zero 
adjoin  the  lii't  in,,  rows  to  /.  gi\iug  the  entire  basis  matrix 
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I  lieu  It  lias  rank  '  >  •  /„  •  in,,  since  only  m„  rows  have  been  added  to  I,  and  lienee  there  can  be  at  most 
in,,  uioic  mdepeiiileol  rows  in  It  iluiu  in  /..  lint  rank  It  I/,  so  that  1/  '  ,S  t  /„  >  m„.  or.S  ?■  1/  /„  iii,, 
coniplclillg  the  piool  o|  Theorem  I. 
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3.  TI1K  ALUMINUM 

Our  approach  In  tin-  solution  of  doubly  coupled  will  la'  In  apply  the  icvCed  primal 

simplex  met  Inal  In  tin-  prohlt  ill.  Tin*  special  structure  of  I  lie  basis  matrix  will  lie  exploited  In  simplify 
the  enmpiltatinnal  and  slorayt  prnldenis  which  occur  Ini  lni"e  problems.  I  lie  levi'i  il  'implex  method 
involves  the  followin':  steps  at  each  iteration: 
a)  Kind  the  simplex  multipliers  jt  =  c/J!  1 
Id  I'liee  nut  the  nonhasie  enlumus  /',. 

<  j  =  <'j  -  tt/’, 

and  choose  a  column  /'»  with  nepative  rs  to  enter  the  itasi'  il  the  current  solution  is  not  optimal, 
el  Transform  the  entering  column  in  terms  of  the  current  basis. 

l\  =  It  '/',. 

d)  Determine  the  column  to  leave  the  basis. 


Ill  I  II 
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where  in,  is  component  i  ol  /'.. 

e)  Pivot  to  update  11  1  and  the  current  solution  to  account  lor  the  basis  change. 

Steps  a)  and  e)  involve  multiplication  by  the  basis  inverse  matrix  11  '.  To  maintain  It  1  hu  larpe 
problems  requires  extensive  storage  and  computation,  since  even  though  11  has  special  'Iruelure.  11  1 
is  essentially  dense  with  non/ero  elements.  Instead  of  performing  the  computations  in  a  I  and  el  dit  colly . 
we  will  solve  the  etpiations 

(2)  7rll  =  rii  (solve  for  w). 

and 

(.1)  11 1\  -  /'.(solve  lor  /\l 

by  makinp  a  transformation  of  the  basis  matrix  It— *K  where  11  is  block  triangular.  The  result in^L 
etpiations  in  terms  of  K  will  make  it  possible  to  exploit  the  special  structure  of  11. 

Consider  a  nonsinpular  matrix  T  defined  so  that  BT  =  11  is  upper  block  triangular. 
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where  H,  is  the  block  diagonal  section  y:l.  //.  and./  are  the  remaining  partitions  of  It 
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Tlic  matrix  li  i>  central  In  I  lie  procedure  ami  will  lie  called  the  working  basis.  From  (4)  and  15)  we  sec 
lli.it 

i  (>  i  /t  =  r;  +  t/r=a  -////,  7. 

I!\  Theorem  I.  It  rail  uluavs  be  |uirl it i< >ii«m I  so  that  tlu-  dimension  of  li  is  al  must  «/„  +  /„. 
TIIKOKKM  2:  The  working  basis  H  is  nmisin^ular. 

IMtOOK:  R  is  nnnsin^ulai'  sinci*  bulb  It  and  T  an*.  Since  all  <dcm<*iits  nl  K  below  li  arc  /cro. 
li  must  br  nnnsin<iular. 

I  n  timl  llir  simplex  innllipliers.  consider  Ki|.  |2|.  M lilt i ply  throiifdi  by  T  fbvinn 

1 7 1  ttK  ttBT  r„T  (1.0 . 0)  T  =  (  1 . 0 . 0). 

Tin-  Iasi  eipialitv  holds  since  only  i,h  appears  in  the  objective  function,  and  by  convention  Vm  is  always 
the  liisl  basic  variable.  Since  T  is  nonsin^ular.  this  imill i plicat ion  will  not  change  the  solution  tt. 

Now  partition  tt  as  77 -  in,,,  tt, . tt,,).  where 

n„  Inis  1/  S  eoniponenls  and  is  the  multiplier  lor  rows  in  the  working  basis  It. 
n,  has  v,  component'  and  i>  the  inuliiplier  for  rows  in  tlic/lh  diagonal  bloc  k  liji  which  is s,  x  s,  and 
uoii'injiiilar.  /  I . 1/.  f  rom  the  slriieture  of  K  in  I  4).  Kc|.  (7)  heeomes 

1H1  Ttji  1  1.0 . 0)  (1/  .S'  components),  and 

db  tt.,11,  •  it, It,,  0  (.%,  components)  j  I . >/. 

will'll'  // ,  I'  I  lie  -lllilll.il  •  i  \  o|  II  1  •  lilt  .11 II I II  tz  tile  eollllllll'  ill  llle  Jill  block.  Solving  gives 

1  llli  n„  (1.0 . O )  //  •  lir-t  row  of  II 

which  can  be  - uli-t i I n 1 1 'il  inlo  I'b  t<>  ”ne 

'  I  I  I  TT,  TT „H  j  j '  /  I . (/. 

lienee  to  obtain  llir  'implex  multiplier'  it  'iilticc'  lo  know  tin*  inverse  of  the  working  basis  and  the 
i n v ei 'c  ol  each  of  die  diagonal  dock'. 

Next  eini'ider  Ki|.  idi  for  Irau'lorming  the  entering  eohnnn  in  terms  ol  the  current  basis.  Detinea 
noii'ingular  change  ol  varialdi  -  hv 

1 12)  ;  T 

I  lieu  /*.  T;.  'o  ki|.  idi  heeome' 

Hi  K;  HI;  B/\  /*,. 

w  liit-li  i'  a  block  triangular- \ 'Inn  and  lienee  easier  lo  solve  I  han  id  I.  Part  it  ion  ;  and  /\  as  ;i . 

and  I  . reflectively .  Then  lid)  can  be  written  as 


hoi  im  coi  i*i  i:d  i.i\i;\h  hum. it  \\i> 
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(14) 

(If)) 


llz„  I  £  lift 


Hjl~j  I'sj  j  I  ■ 


Solving  ( Ifi)  {lives 

(16)  = 

which  when  suhslilnle)!  into  (14)  {lives 


(17) 


li 


r 


If  /J,  is  not  a  coupling  column,  these  formulas  simplify  since  than  l*KJ  =  ()  for  all  hut  oney(  =  1 . 

q).  Hence  hy  (16)2j  =  0  for  all  hut  one  j  and  the  summation  in  (17)  has  only  one  term. 

It  is  now  a  simple  matter  to  obtain  /'*  from  2  usinft  /'*  =  T;.  With  l\  partitioned  as  (/’,«.  /'.1 . 

I’h,,)  the  structure  of  T  in  (4)  gives 


(IH) 


—  I  z„  —  z„.  and 


(l‘>) 


!  *j  I  jZn  "4  I Zi  I  jZti  “4  Zj  j  I 


where  i>  the  suhmalrix  of  1  containing  the  rows  in  the  /th  block.  This  completes  the  transformation 
of  the  column  entering  the  basis. 

4.  CIIA!N<;i!N<;  THE  basis 

Pricing  out  eolumus  to  select  the  entering  column  and  choosing  the  column  to  leave  the  basis  un¬ 
done  as  in  the  ordinary  revised  simplex  method,  so  it  only  remains  to  describe  the  updating  procedures. 
Since  the  entire  basis  inverse  II  1  is  not  needed,  the  updating  requirements  will  he  somewhat  different 
from  those  of  the  ordinary  revised  simplex  algorithm,  in  particular,  reviewing  the  solution  of  Kqs.  (2) 

and  (.4)  shows  that  it  is  sulficicnl  to  update  H  ’.  Hlt'  (/=  I . q).  and  I  at  each  iteration. 

Before  describing  the  various  eases  which  can  occur,  we  derive  a  general  result  for  updating  the 
working  basis  inverse. 

TIIKOKKM  4:  If  a  basis  change  can  he  described  by  *11  '  =  Ell  '.  where  "'ll  1  is  the  basis  in¬ 
verse  after  (lie  change,  and  E  is  any  transformation  matrix,  then  the  working  basis  inverse  can  In- 
updated  by 

(20)  *H  '  =  (/■;,  +  K.l')H  '. 


where  E\  and  E<  are  partitions  of  E  to  he  described  in  the  proof. 

PROOF:  From  the  definition  and  nonsingularity  of  II  and  T.  in  (4).  (4) 

(21)  R  '  =  *T  *11  1  =  *T  Ell  1  =  *T  ETR  '. 

Here  all  *'ed  symbols  relate  to  the  system  alter  the  basis  change  is  made.  Writing  (21 )  in  partitioned 
form  and  using  partitioned  inverse  theorems  gives 
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I  n  update  the  v\ < i tk i ii ji  basis  inverse.  mile  llial  it  appears  in  the  upper  left  hand  partition  of  *R  lienee 
deleting  all  Iml  llial  siihmatrix  fiives  the  l'i illnw inji  speeiali/.alion  ol'  (22): 


1 2d ) 


'li  1  = 

/ 

o 

J 

a:. 

A’, 

a;, 

AN 

/ 

() 

A’, 

A. 

< 

1 

li  ' 


VH  1 


=  (A\  +  EtV\tt 
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I  hn-  K ■  +  Ad  is  a  transformation  matrix  lor  the  working  basis  inverse. 

I  .el  the  eolnmiis  from  I  lie  block  diagonal  section  of  B  he  called  "key"  columns.  The  remaining 
columns  of  |{  are  called  "non-key."  There  are  several  eases  to  consider  in  the  updating  procedure: 

< !  \SK  I :  The  column  leaving  the  basis  is  non-key.  Then  the  entering  column  can  he  hrou«ihl  into 
the  basis  as  a  non-key  column,  and  the  standard  updating'  formula  for  B  1  is  *B  1  =  EB  '.  Here  E 

i-  an  elementary  matrix,  eiptal  to  the  identity  except  in  the  /ill  column  which  is  fjiven  by  [tji,  . 

where 


__«j,  i  =  I .....  M 

12  n  V'  ,/r- 

i 

•»p  =  — 

On 

(recall  that  the  rib  basic  column  is  leaving  the  liasis).  Since  the  leaving  column  is  non-key.  partitioning 
E  as  in  Theorem  d  (lives  Aj  0.  and  A’,  is  an  M  —  SXM  —  S  elementary  matrix  equal  to  the  identity 

except  in  the  rth  column  which  is  (t/i . i/u  s)'. 

l  o  update  the  working  basis  inverse  lor  Ease  1,  substitute  these  into  (20): 

1 2d i  'li  1  =  (A’,  4  AT)//  1  =  (A',  +  01)11  '  =  A,//  '. 

lienee  li  1  is  updated  by  a  single  pivot  operation. 

None  ol  the  key  columns  in  B  ehan>ie  in  Ease  I.  and  hence  none  of  the  diagonal  blocks  Hj\  in  li\ 
will  change.  Thus  the  block  inverses.  //,,'.  require  no  updating.  To  update  I  recall  that  *E  =  —  */i,  '*,/• 
Now  “li,  1  H,  1  as  shown  above,  and  './  is  different  from./  only  in  the  rth  column  which  is  replaced 

b\  the  last  S'  components  of  the  enterin'!  column  t/\ . /'«,,)'.  Thus  only  the  rth  column  of  J  will 

chun-ie.  and  this  will  be  replaced  by 
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m  -li,  1 ( l\, . /*„)'  =  -  U. . 

which  has  already  been  caleiilaled  in  transforming  the  filtering  column.  Tlii*  complete*  llie  updatin': 
caleiilaliims  fur  ( !ase  I . 

CASK  2:  The  column  leaving  the  basis  is  a  key  eidtiinii  (from  the  block  diagonal  section). 

(1  ASK  2a:  both  the  leaving  eulumn  and  the  enterin':  column  are  from  the  same  Idnek  //, t .  Then 
if  the  entering  eulumn  will  leave  lij,  nonsingular.  a  direet  pivot  can  he  performed  and  the  basis  change 
can  he  deserihed  hy  *B  1  =  EIJ  where  E  is  an  elementary  eulumn  matrix.  The  K  matrix  differs 

from  that  in  Case  1  only  because  the  (17 . r)u)'  eulumn  is  nuw  in  the  key  section  <>l  the  matrix. 

Thus  £’i  = /.»  \..u  v,  and  A’*  has  only  une  nunzero column  ii/i . t/w  s which  is  the  r—  (  t/— .S' ) t h. 

To  update  the  working  basis  inverse  apply  formula  (20): 


*li  '=(E[  +  E1V)H  ' 


~Vi 

=  H  •+  ;  vli  \ 

.T/.W-.x. 


where  t  is  the  r—  (A/-.S’)th  row  of 

In  the  block  diagonal  submatrix  H only  the  r—  (,V-.S)th  column  will  change.  Hence  only  one  diagonal 
block  inverse,  say  lij will  change.  lij,'  will  he  updat<*d  by  a  single  pivot,  or  equivalently. 

(28)  *HJ}'  =  EHj,' 

where  E  is  an  elementary  column  matrix  formed  from  the  elements  of  the  new  column.  This  change 
will  leave  Hj,  nonsingular  if  and  only  if  the  pivot  element  in  this  new  column  is  nonzero.  This  condition 
must  he  checked  to  see  if  Case  2a  can  he  applied. 

The./  submatrix  will  not  change,  and  only  the/th  block  of  H,  1  changes,  so  in  J  ’  =  —  H,  './  only  the 
,/llt  partition  will  change.  The  updated  version  is  given  by 

(29)  —  *H;,'  )Jj  =  —  EH,, './/  =  AT,. 

so  the  same  elementary  matrix  is  used  to  update  I  . 

CASK  2h:  The  column  leaving  the  basis  is  a  key  column  from  block  Hj,.  Case  2a  cannot  be  used 
either  because  the  entering  column  is  not  from  the  same  block  lit  may  he  a  coupling  column)  or  because 
the  nonsingularity  test  in  Case  2a  failed.  Then  we  can  avoid  making  lij,  smaller  only  if  there  is  an 
excess  column  (see  Figure  2)  from  block  j  which  can  be  exchanged  with  the  leaving  column.  If  there  is 
such  a  column,  say  the  At  li  basic  column,  then  after  the  exchange  *11=  HE.  where  E  is  a  permutation 
matrix,  an  identity  matrix  with  the  rth  and  At  It  columns  exchanged.  Since  E  1  =  E.  II  1  =  Ell  1 
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Thru  (2(h  yields  '//  1  (E i  +  E>1  )B  where  E,  is  an  M  —S  X  M  S  idrnlily  rxrrpl  for  a  zero  in  tin* 
/.ill  diagonal  |iosition.  and  E-  is  zero  except  for  a  one  in  tin-  At h  row  and  r—  (  1/  —  .S'fth  column. 

Hence 

I 

I 

I 

1.40)  *//  1  =  I  A',  +  EJ)B  '  = 


where  r  is  the  r—  (  l/-.S)th  row  of  I  .  This  is  a  valid  interchange  if  and  only  it  E\  +  E^E  is  nonsingular, 
which  is  true  if  and  only  if  the  /l li  clement  of  the  row  r  is  nonzero.  If  all  elements  of  r  in  the  excess 
columns  are  zero,  then  no  interchange  is  possible  and  we  proceed  to  Case  2c. 

If  an  exchange  occurs,  one  column  of  the  block  Bj\  will  change.  Hence  the  inverse  can  be  updated 
h\  a  simple  pivot 

i  dl) 

where  E  i>  an  elementary  matrix.  The  elements  needed  to  form  the  eta  column  in  E  are  found  in  the 
/.th  column  of  l  j. 

To  update  I  .  note  that  by  definition  *l'  =  —*Bt  '*./•  Only  the  ytli  block  of  B\  1  changes,  and  a 
single  column  of,/  changes,  but  this  column  is  zero  outside  the/th  block  Jj.  Hence  only  the  submatrix 
/  ’j  needs  to  be  updated. 


B  ' 


*—  row  k. 

■ 


C12)  *El  =  -*Bjy'*J]  =  -EBi:*Jj. 

.Now  ¥Ji  =  Ji  except  in  the  /.ill  column  which  is  replaced  by  the  leaving  column  which  we  will  suppose 
to  be  the  /th  column  in  B, i.  Thus  BJ['*JJ  =  —  Vj  except  in  the  Xth  column  which  becomes  the  /th  unit 
vector,  so  that 

i  Tii  *Ei=EVj 

except  in  the  /. t h  column  which  is  the  negative  of  the  eta  column  of  A’. 

This  completes  the  updating  required  for  an  exchange  of  key  and  non-key  basic  columns.  After 
the  exchange  the  leaving  column  is  non-key.  so  Case  I  can  be  used  to  bring  the  new  column  into  the 
basis,  li  should  he  noted  that  Case  I  uses  the  elements  «„  of  the  transformed  entering  column  (see 

i2fil  and  the  vector  (ii . z,/)  (sic  (2h)).  The  interchange  will  affect  these  quantities.  To  update 

them  interchange  r’l,.  and  (//.,.  and  replace  z,  by  Ez ,. 

(i  \SK  2c:  The  column  leaving  the  basis  is  a  key  1*011111111  from  block  Bj  1.  and  neither  Case  2a  nor 
2b  apply.  \\  lien  the  column  leaves,  the  new  *B,  1  will  have  one  less  column,  and  hence  to  remain  square 
and  rionsingular  it  must  also  lose  a  row.  Tin*  process  is  most  easily  described  by  a  rcparlilioning  step 
followed  bv  an  application  of  (iasc  1.  In  the  repartitioning  step,  the  leaving  column  is  shifted  to  the 
exec*.*,  column  partition,  and  some  row  of //;)  is  made  an  excess  row. 

Without  |o**>  of  generality  assume  that  the  pair  being  shifted  is  the  first  column  and  row  of/Zn. 
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The  basis  matrix  before  ami  alter  the  change  are  given  below.  All  element  ol  the  matrices  ate  ulenl i<  a L 
only  the  partitioning  changes. 


(34) 


Ibis  is  the  original  partitioning.  The  row  ami 
eoluinn  indicated  by  flashed  lines  will  be  added 
t<i  the  non-key  section  resulting  in  the  new  parti¬ 
tioning  scheme  {liven  below. 


*(, 

*// 

*./ 

*HU 

— 

*«, 

In  this  new  partitioning  of  the  basis.  *C  has  be¬ 
come  larger  by  one  row  and  one  column.  *li\i  has 
become  smaller,  and  the  other  partitions  change 
in  eorrespondin}>  ways. 


Now  *B  =  B.  but  because  of  the  changes  in  partition  sizes.  *T  and  *R  *  R.  Hence  we  must 
compute  and  *V. 

*Bn'  is  computed  via  standard  formulas.  II 


If 

X 

) 

X 

_ 

where  /  contains  all  but  the  first  row  and  column,  then 

(37)  = 

This  is  possible  only  if  W  *  0  which  provides  a  criterion  for  choosing  the  row  to  be  shifted.'*' 
To  obtain  *H  1  recall  that  B=*B  so 

,;*«)  R  =*T  '*B  1  =  *T  B  '  =  *T  TR  '. 


tin  j’fiM'niL  it  I  In*  At  li  column  <»t  li,  i  i»  bcitii*  shilled.  thru  I  li«*  / 1  h  row  <  an  lit*  'hilled  il  tin*  /tli  clement  »•!  /.  in  It  , '  i*  ikhi 

zero.  There  must  always  In*  at  IraM  our  nnn/rro  rlrinrnt  in  row  /,  since  i*  nmiwin^iilai 
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III  pari  il  ii  ilini  li  >1111  litis  is 


wlirrr  li  is  llic  first  iiiliiiiiii  of  —  //  '///<>  1  am!  \  U  ,  }’]'  is  ih«>  first  culiiinn  of//,,1 


wlirrr  i  i'  I lu*  lirsi  row  n!  I  . 


H  ' 

h 

i  ll  ' 

rh  4  K 

I  hr  vrrliil  h  t’l  >  1 1 1 1  >1 1 1  I  a« 

i  II  i  /i  fir-i  roliimn  i»l  H  'HH,  1 

=  H  'll  1  first  rollllllll  III  If)  1  I 

H  ’//Iff  Y,<h‘ 

H  '//,( U  )  )’. 

wlirii'  // 1  i»  thr  lir»l  iKirlilion  >>l  //. 

\\  r  iioir  ili.il  I  hr  ii'|i.ii  t  il  iiiiiiii^i  lirr*'  ili, nidi's  all  |i.irt  it  n  m-  nl  B.  Ilnur  in  l  In-  rx|irrs«.juii  H  <>  lilt, 
tnl  llir  working  |ms|'.  all  Imii  t ,ii  lm»  i  lian^r.  \rvrrtlirlr»s,  wr  nrnl  ■  m I \  ailil  a  "Imrili'l"  In  H  1  I 
/rt  ' H  Mailing  1 1 1 mi  llir  i'i|ii.il imi  "I"  1  'H  'KT  '  ami  ar^uin^  as  almvr.  a  Inriiiula  lm  ii|nlalni 
I 


I-  o|>l. mil'll 
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(42) 


r,-.  >« 

1  1  If 

y 

*1  = 

if 

i 

0 

where  r  is  the  first  row  of  I'.  I',  is  I  lie  rest  of  I  lie  first  liloek  of  /  .  and  /  is  all  oilier  Idoeks  o!  I  .  Note 
dial  *1  lias  one  less  row  and  one  more  column  than  /  and  dial  the  onl>  nontrivial  change  oeeiirs  in 
the  first  liloek. 

I’crfnrmiii}!  these  operations  repartitions  the  basis  matrix  so  that  the  leaving  column  becomes 
non-kev.  A ppf \ ino  false  I  w  ill  then  complete  the  basis  change  lor  Case  2e. 

CASK  3:  l  sin;:  the  above  eases  the  simplex  method  can  be  performed,  bill  die  working  basis 
will  increase  in  dimension  bv  one  each  time  false  _V  occurs,  lienee  il  max  lie  desirable  to  periodical!) 
repartition  the  basis  bv  moving  excess  rows  and  columns  into  the  block  diagonal  section,  csscutiuliv 
the  reverse  of  (  also  2c. 

Suppose  we  have  an  excess  row  and  an  excess  column  from  block  /.  Consider  the  following 
siibmatriees  _  _ 

1  o  (i  •—excess  row 

I _ i  1 _ ' _ i 

ltd! 

I - 1  r - ’ 

y  /fj,  )• —  /t I)  diagonal  block  in  //,. 

L _ _ _ i  ,. _ 

\ 

excess  column 


lirintuu^  the  row  and  eoltimn  into  the  kev  section  would  mean  addin;:  them  to  If,,  resulting  in  a  larger 
/lit  diagonal  block. 

o  (i 

(Hi  ♦//„=' - • - < 

y  H,< 

W  e  alreadv  know  //, , 1  and  we  want  to  compute  the  inverse  of  the  new  block.  If  thi«  inveisc  exist*  sup¬ 
pose  dial  il  i*  partitioned  as 

U  A 

i  Hi  . 

>  / 

l  licii  |  t|  the  block*  ate  pven  bv 

U  I/to  /j/f  ,'yl 

(•If) i  \  U  tiH 

V  H„'yU 

/  (<:  H  ,'v\. 


and  the  inverse  exist*  it  and  onlv  it 
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I'm  < -<  i  in  |  ii  it  al  i<  ii  ki  I  purposes.  (mil-  that  y  is  just  tlic/th  part  it  i<ui  of  the  column  in  t  t'«irr<*s|i<iti«li 

In  ill*-  it  il  n  1 1 1  n  lii-iiifi  1 1  it  i  \  i*il.  I  Iriirr  In  test  Ini'  possible  pairs  in  In*  moved  requires  <■<  i  in  put  al  inn  ill  an 
ilium  product  al'  fj  v\  i 1 1 1  a  rnlinim  nl  I 

Km  convenience  in  expression.  anil  without  loss  nf  ^cnmalily.  we  afiain  assume  that  the  last  row 
anil  i-i ill i in n  nl  l lie  null -key  seelimi  will  heeniiie  the  first  mw  anil  euhiinn  of  tin*  key  section.  The  ele¬ 
ments  nl  *41  will  lie  exactly  the  same  a>  the  elements  of  IS  —  only  the  partitions  will  change.  The  new 
winking  basis  'It  will  heenme  smaller.  To  tin < I  an  expression  fur  ils  inverse  consoler  the  expression 

i  IK)  R  ’=  T  1  *H  1  =  *T  '*1*  '  =  *T  TR 

Writing  this  in  partitiiiiieil  forin  will  nivc  the  lollowinu  matrix  equation: 


1 

■ 

1 

1 

— 

'll  1 

'It  "inn, 1 

t 

/ 

. 

0 

1 

l 

0 

It  ' 

-it  'nit, 1 

0 

It,' 

-*r 

1 

, 

I 

0 

V 

. 

-  .. 

Taking  i  mi  I  \  the  lir»i  rows  ami  columns  of  this  equation  aives: 


•it  ' 

= 1 

/ 

O 

1 

’ 

0 

1  1  1 

h 

[  I 

it 

j 

1 

1 

1  1 

f  j 

0 

1 

where  It  is  1 1 1 s |  It  '  with  the  Ll'l  row  anil  columu  ileleleil.  Thu-  to  act  (he  new  working  liasjs  inverse, 
mciclv  ilelcte  the  la»l  mw  ami  I  lie  l.i'l  column  in  the  current  working  !ia»|s  inveise. 

I  o  i  alcill.lle  ‘I  ll*e  the  cqii.llioii 

ill  I  1  It  II  It  It  R  It!  1 


mi  wnlma  till'  in  puililioiieil  Ioiiii  ami  pio<  emhua  as  ahovc  void'  ih>  n  ill 


U  >! 

i  i  )  i  /» 

I 


when  I  is  tlo  lost  partition  "I  I  h"  the  la>t  i  ••loiiio.  ami  I  i«  tin  mu  oioii;  p.otihmi-  o|  I  less  thi 
la-1  >  "loom  f  "l  till-  to  In  ■  "inpnleil  we  inn-1  timl  i/i  wlm  h  I-  tlo  holtooi  low  ol  the  woikui^  ha-i-  li  -» 
it-  1. 1 -i  .  oiiqM.iii  nl  c  I  hi  Hoikm;  basis  |.  not  *  anicil  a  Ion.:  «*\plo  it l\  .  ,  we  100-1  1  omplile  1/1. 


It  (•  •  III  l r •  •in  1  <1 1 . 
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where  (>  and  //  are  partitions  of  the  basis  matrix  B  and  /  is  updated  at  each  iteration  of  the  process. 

(53)  [i/».  {|  =  last  row  of  II 

=  last  row  of  f/  +(last  row  of  II)- l 
=  f!+h  •  V  (A'=last  row  off# 
li  —  last  row  of  II ) 

=  *+[/».  <>J  I 

=  ti+  (i  ■  I  i . 

and  dropping  the  last  element  of'  this  jiives  if/. 

In  the  above  ealeulations  the  most  eomplieated  formulas  were  those  for  updating  /  in  the  two 
repartitionin}’  procedures.  Ki|s.  (42)  and  (52).  An  alternative  procedure  in  these  eases  is  to  compute 
I  from  its  definition  l'  =  —  li,  1 J .  In  each  ease.  only  one  partition  of  I  changes.  say  partition  I  ,.  •liven  by 

(51)  *r,  =  - 

with  Wji  of  dimension  Sj.  To  compute  this  reipiires  s'j  miiltipliealions  for  each  uon/.ero  column  of  *J, . 
a  total  of  at  most  ( M  —  .S’ )  X .sj  multiplications.  The  updatiii"  ealeulations  reipiire  on  the  order  of 
(M-S)X.s  multiplications.  Hence  they  are  computationally  superior.  Iml  reipiire  more  extensive 
program  Ionic. 

Alter  performing  the  appropriate  updatinn  procedure,  we  are  ready  to  start  the  next  simplex 
iteration.  Thus  the  description  of  the  basic  algorithm  is  complete. 

5.  SPECIALIZATION  TO  PROBLEMS  WITH  ONI  .  COI'PLINO  ROWS 

Kor  problems  which  have  no  couplinn  columns,  the  al"nrillmi  simplifies  considerably.  The  major 
simplification  is  that  no  repartilioiiinn  will  ever  he  necessary  and  there  will  never  by  any  excess  rows. 
llei.ee  Cases  2c  anil  3  of  the  updatin':  procedure,  which  are  the  most  complicated,  arc  never  needed. 
The  working  basis  II  in  (6)  will  always  have  exactly  as  many  rows  as  there  are  coiiplinn  constraints, 
and  each  ol  the  blocks  II,,  has  dimension  m,  (see  (1)1.  delations  1 10).  ill)  lor  the  simplex  multipliers 
remain  the  same  as  do  relations  I  IfiM  I1))  for  the  transformed  enlerinn  column.  In  updating:,  only  ( iases 
I.  2a.  and  2h  can  occur.  These  remain  essentially  the  same.  The  computations  involving  I  simplify 
because  each  column  of  I  except  the  first  has  only  one  non/.ero  partition.  This  specialization  of  the 

algorithm  is  very  simil.n  to  the  method  proposed  by  haul  |5|  and  is  described  hv  l.asdon  in  |b|. 

(».  APPLICATIONS  TO  PROIH  CTION  ANI)  INVENTORY  PROBLEMS 

Consider  a  corporation  which  wishes  to  schedule  the  piodm  lion  of  A  products  .u  /  plauls  for  T 
lime  periods  mlo  the  future.  \t  each  plant,  ami  for  each  pciiod  tile  demand  loi  car  h  piodm  I  is  con¬ 
sidered  known  and  mils'  he  met  in  dial  period.  The  opeiation  o|  the  /th  plant  m  the  llh  time  period  is 

heme  limited  by  these  A  demand  coii'ltaitils  ami  al»o  hv  r  coii'liainls  on  loe.illv  available  lesomces 
le.e  .  plant  capar  ily .  lahoi  l  fivin;:  ti*c  to  a  con»l t  .tint  block  w  it h  A  '  /  low  ».  I  lien  arc  /. T  such  diapin.il 
block'  lllese  blocks  ale  coupled  hv  eoll'tl.Olll'  oil  staler'  colpoialc  lr»ollli  t-s  wliiill  ale  allot  .lit  d 
a<  loss  ihi'  various  plants  ami  hud;:ctt-d  ovei  lime  if.;.,  coipotalc  ■  apital.  «t  an  c  law  iiialei iaU.  hi;ld\ 
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■'ki IIimI  labor).  In  aililitinn  In  producing  lor  immediate  demand.  an >  | ilanl  may 

al  Produce  a  product  anil  place  il  in  inventory  lor  Inline  use. 

Ii)  Produce  a  product  and  ship  il  In  siiiiic  nlher  plant  which  has  a  shortage  of  that  product. 

Kach  <>|  the  inventory  and  Iranspnrtatinn  activities  gives  rise  In  a  ciduinn  which  cnuplcs  Iwn  nf 
the  diagonal  Idncks.  Thus  wc  have  a  doubly  cnuplcd  linear  program  In  snlvc.  The  nuinher  of  rows  is 
mi  the  nrdcr  nl'  ( A.  f  r I mi  trills  large  prnhlcins  mas  result.  There  are  KI.T(2L  4  T  —  .'f)/2  coupling 
enlnmiis  arising  limn  the  inventory  and  traiispnrtalinn  activities,  hut  these  have  vers  special  slruetiire. 
Kaeli  enliimn  has  mils  a  cost  cncflicicnt.  a  single  4  I  in  the  /.ill  demand  eipiatinn  for  nne  lilnek.  and  a 
single  I  in  the  /.tli  demand  eipiatinn  for  annther  lilnek.  lienee  tiles  mas  he  stnred  implicit  Is  and 
priced  nut  ssitli  minimal  effort.  Since  these  coupling  aetisilies  incur  a  cost  in  additinn  In  the  prndiiiiiun 
enst.  we  anticipate  that  even  though  there  are  mans  such  activities,  relatively  few  svill  he  prnfilahle. 
lienee  in  alls  basis  there  shnulil  he  relatively  less  coupling  enlnmiis  sn  that  the  algorithm  deserihed 
can  he  applied. 

A  nuinher  nf  enmputatiniial  siinplilieatinns  appear.  In  computing  the  transfurnied  entering 
enliimn.  at  ninst  tssn  nf  the  in  llfi)  ssill  he  nnii/ern.  sn  (17)  simplilies  ennsiderahly.  The  special  form 
nf  the  emipline  cnluiiuis  implies  that  in  ,/  any  coupling  enliimn  has  only  2  nnn/.crn  elements  4  I  and 
I.  while  an  excess  enliimn  has  mils  nne  part  il  inn  nnn/.ern.  lienee  in  V  —  —  H ,  'J  a  coupling  enliimn 
has  at  must  twn  nnn/.ern  partilimis  and  these  are  columns  nf  the  lilnek  inverses  ltn'.  An  excess  enluinn 
lias  nne  nmi/ern  part  it  inn  in  l  .  lienee  it  is  prnhahly  best  to  compute  I  at  each  iteration  instead  nl 
updating  it.  This  is  desirable  since  the  must  complicated  update  formulas  are  those  involving  I  . 

7.  COMPl  TATIOWI.  KKSI  I.TS 

The  algorithm  deserihed  above  has  been  ended  and  used  In  solve  a  number  of  lest  problems  nl' 
the  tspe  described  in  section  (>.  The  program  was  written  in  FORTRAN  V  Inr  the  l  nivac  1108  emit- 
puter  at  <  aisc  Western  Reserse  I  diversity.  The  special  slruetiire  nf  these  problems  made  it  possible 
In  solve  reasonably  large  programs  all  in  cure.  Ml  problems  were  solved  in  single  precision  arithmetic. 
W  believer  a  block  inverse  nr  the  working  basis  inverse  had  been  updated  50  times,  it  was  re-inverted 
using  a  standard  (iaiissian  elimination  routine,  (bind  numerical  accuracy  was  obtained  in  that  different 
i  ini'  mi  the  same  problem  yielded  solutions  which  were  the  same  In  seven  significant  figures.  The 
code  was  not  written  to  be  competitive  with  commercial  routines,  but  rather  In  investigate  the  effects 
nl  varimi'  pricing  and  rcpartil inning  strategies.  Nevertheless  the  solution  times  recorded  are  encouraging. 

Data  describing  the  test  problems  js  given  in  Table  I .  The  notation  used  is  as  in  section  6.  For  each 
problem  si/e.  two  problems  were  formulated.  The  lower  numbered  problem  of  each  pair  was  constructed 
In  he  relativelv  ea»v.  in  that  lew  coupling  columns  appear  in  an  optimal  basis.  The  second  problem  in 
each  pair  is  derived  from  the  first  hy  adjusting  the  right  hand  side  demand  and  resource  availability 
vector  so  that  more  coupling  activities  are  rcipiircd.  Hence  it  is  more  diflieuli.  For  all  problems,  phase 
I  was  inili. iteil  with  a  basis  consisting  nl  slack  variables  for  all  resource  constraints  and  artificial  vari¬ 
ables  Ini  demand  <  cU'lruinl-. 

Table  2  describes  the  effect  of  three  different  pricing  strategies.  Pricing  strategy  one  allowed 
i  niiplmg  column'  to  cutci  the  h.i'i'  at  any  iteration.  Il  led  to  long  running  times  and  large  working 
bases  since  maiiv  coupling  columns  tended  to  enter  the  basis  in  phase  I.  even  in  problems  for  which 
t lie i e  were  none  in  the  optimal  h.i'i'.  Pricing  strategy  two  did  not  allow  coupling  columns  to  enter  the 
b.i'i'  in  the  fust  1/  iterations  unit"  all  other  columns  priced  out  optimally.  Il  produced  a  substantial 
i i*i In*  lion  in  running  time.  Stralegv  three,  which  was  the  most  successful,  allowed  no  coupling  columns 
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T.AKI.K  1.  Ti*sl  Problem  l)eseri|>timis 
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Taui.K  2.  Kfl'ert  <»('  Pricing  Slr»il«*jti«*s 
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to  enter  the  basis  (unless  necessary)  until  all  artilieial  variables  have  left  the  basis.  Pricing  strategy 
three  was  used  for  all  of  the  remaining  runs.  All  problems  in  Table  2  were  solved  w  it  h  the  re  partitioning 
procedure  of  Case  3  attempted  every  10  iterations  (see  section  4). 

Table  3  shows  the  effects  of  various  reparlitinning  strategies,  i.e.  strategies  for  employing  <  Case  3. 
The  strategies  tested  are  to  attempt  Case  3: 

1.  never 

2.  every  10  iterations 

3.  every  five  iterations 

4.  every  iteration 

5.  whenever  there  are  at  least  10  excess  columns 

6.  whenever  there  are  at  least  five  excess  columns. 

The  different  strategies  often  gave  rise  to  slightly  different  numbers  of  iterations,  probably  because 
different  strategies  result  in  different  orderings  of  the  rows  in  the  problem.  Hence  if  the  basis  is  de¬ 
generate,  ties  may  he  broken  in  different  ways,  and  different  columns  will  leave  tin-  basis. 

I  sing  the  strategy  of  never  employing  Case  3  involves  a  tradeoff.  The  computations  ol  Case  3 
never  have  to  he  performed,  and  Case  2c  is  performed  less  often.  This  is  because  excess  columns 
accumulate  in  the  non-key  section  so  the  interchange  ol  Case  2b  is  more  likely  to  succeed.  However 
if  Case  3  is  not  performed,  then  the  dimension  of  the  working  basis  increases  whenever  Case  2c  is 
performed,  and  never  decreases.  The  overall  residt  is  that  the  number  of  iterations  per  second  is  lowest 
among  all  strategies  tested.  Hence  it  is  desirable  to  repartition  the  working  basis  periodically.  Among 
the  other  strategies  tested,  no  consistent  differences  emerged. 
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